Disorder Averaging and Finite Size Scaling 
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We propose a new picture of the renormalization group (RG) approach in the presence of disorder, 
which considers the RG trajectories of each random sample (realization) separately instead of the 
usual renormalization of the averaged free energy. The main consequence of the theory is that 
the average over randomness has to be taken after finding the critical point of each realization. 
To demonstrate these concepts, we study the finite-size scaling properties of the two-dimensional 
random-bond Ising model. We find that most of the previously observed finite-size corrections are 
due to the sample-to-sample fluctuation of the critical temperature and scaling is more adequate in 
terms of the new scaling variables. 
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Finite size scaling (FSS) is a very powerful tool of the- 
oretical physics: it allows us to extract some properties 
of the infinite system near a phase transition by studying 
finite, numerically accessible samples. It is therefore of 
major interest to have a clear theoretical background be- 
hind the bold extrapolation from finite to infinite sizes. 
Though the basic concepts can be summarized in a few 
lines, the theory of FSS is far from trivial |Q] even for 
clean systems. Randomness brings in additional com- 
plexity, and a deeper understanding of FSS in disordered 
systems is still lacking. The main difference with the 
clean case is that somehow we have to average over the 
different random samples. There is an on-going discus- 
sion of whether the way the disorder average is taken in- 
fluences the FSS results or not j^[-j5j , and if it does, what 
is the "correct" average? The importance of the details 
of averaging is demonstrated most spectacularly by the 
so called Chayes et al theorem ||, which claims that a 
certain finite-size correlation length exponent cannot be 
smaller than 2/d, d being the dimension of the disorder, 
for any phase transition driven by quenched randomness. 
It turns out || that the proof of this quite general state- 
ment relies entirely on the specific manner the disorder 
was generated: a slight change in the ensemble of the 
random samples gives a different final result. Further 
studies along these lines showed that in some cases even 
the numerically measured quantities do depend on the set 
of the disorder realizations , though there are claims 
that they shouldn't §. 

In this Letter we propose to understand the role of 
the disorder based on the scaling of a single realization 
instead of renormalizing the averaged free energy. We 
argue that, eventhough the difference between the two 
approaches is expected to vanish for infinite systems and 
short-range interactions, it might be crucial for finite 
samples and/or long-range forces. From a practical point 
of view, our main result is that disorder averaging should 
be done after finding the critical point of each sample in- 



dependently. We demonstrate how this works in practice 
by performing an extensive numerical study of the two- 
dimensional random-bond Ising model. 

First, recall some basic ideas of FSS in clean systems. 
Close to a continuous phase transition the correlation 
length, £, diverges as £(T) ~ t~ v with v the correlation 
length critical exponent and r = \T — T c \ the distance 
from the critical temperature T c of the infinite system. 
For a finite system, the size L itself is measured in units of 
£, i.e. a physical quantity Q depends on L only through 
the ratio L/£, i.e. 



Q(T,L) = L^(L 1 /»t), 



(1) 



where y describes the L-dependence at criticality. 

The surprise in Eq.(EJ) is that it contains the infinite 
system's correlation length (or critical temperature T c ), 
eventhough in a finite system the actual characteristic 
length £,l(T) is typically different from £(T). Indeed, 
while in the high-temperature phase £j, ~ £, there is a 
temperature T C (L) where the correlation length reaches 
the system size, i.e. £l ~ L. Below this temperature the 
whole sample becomes correlated and £l is defined by 
subtracting this overall correlation. We call the temper- 
ature T C (L), the critical temperature at size L. In terms 
of RG flows, the trajectories bend towards high temper- 
atures for T > T C (L), towards zero for T < T C (L), and 
they "stick around" a fixed point for T = T C (L). 

Admittedly, T C (L) is not a very well defined quantity, 
but the peak in a susceptibility or specific heat may give 
it a sensible meaning. Still, both the RG picture and the 
behaviour of £l suggest that the scaling variable of the 
problem is tt, = T — T C (L) instead of r, leading to the 
FSS formula 



Q(T,L) = Wf(L 1 l v T L ) 



(2) 



For clean systems the connection between Equations 
(EJ) and (0) is delivered by the scaling of T C (L): 
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FIG. 1. RG trajectories of temperatures for a single disor- 
der realization as a function of x = \n(L/L'). The solid line 
represents T' C (L') and the dashed line is for a close tempera- 
ture T'(L'). The inset shows the difference of these two. 

T C (L) =T C + CL- 1 '". (3) 

The constant C in this equation is not universal, it de- 
pends e.g. on the boundary conditions. But once the 
details are fixed, C is constant for large Us. Substitut- 
ing Eq.(|J) into Eq.(|2|) gives us the usual form of FSS 
(Eq.©). 

Now we argue that in the presence of randomness, fix- 
ing the disorder distribution and the boundary conditions 
is not enough to keep the value of C in Eq.(||) constant. 
Due to the randomness, C will fluctuate from sample to 
sample and under renormalization. Consequently, T C (L) 
of a given disorder realization will fluctuate as well, pre- 
venting the use of the infinite system's T c for all samples 
and sizes, like in Eq.(Q). At the same time tl remains a 
good scaling variable and, after an appropriate averaging, 
Eq.(|) holds. 

The basic observation in support of the above is 
that the RG trajectories for disordered systems are not 
smooth, but rather look like a random walk. Each time 
we integrate out high-energy degrees of freedom, they 
will contain some randomness. Accordingly, the renor- 
malized temperature will pick up a random part, too. Of 
course, this fluctuation of the RG trajectory will scale as 
a negative power of L, in the gaussian case as L~ d / 2 , and 
disappear if L — > oo. But in the case of FSS, we are com- 
paring temperatures as close as ~ , so for a v close 
to 2/d the random walk of the RG trajectories becomes 
important. Since T C (L) itself changes under renormaliza- 
tion, we find that the critical surface will be random and 
different for each disorder realization. 

Now let's take a random sample of size L and consider 
the RG trajectory starting at a temperature T close to 
the sample's T C (L). After a renormalization step we get 
the renormalized values L' , T", and T' C (L'). According to 
the above arguments both T" and T'JL') have a random 
part. But both T' and T' c are temperatures, and they 
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FIG. 2. 20 samples of susceptibility per spin versus tem- 
perature of system of size L — 64 with r — 0.5. 

are close to each other, so it is natural to suppose that 
their fluctuating part will be almost the same, i.e. they 
are correlated. The main consequence of this correlation 
is that T'(L') - T' C (V) will be a smooth function of L', 
scaling with the exponent 1/v, while T'(L') — T c will show 
the large fluctuations of the random walk (see Fig.l). 

The standard (grand canonical S) average uses T c 
only, and completely neglects the correlations. Such an 
approach is justified as long as the fluctuations of the RG 
trajectories are much smaller than their distance from T c . 
In the case of FSS, however, they might be of the same 
order and the correlations become important: one has to 
use tl = T — T C {L) to extract the critical exponents. If 
T is at some distance (but not too far) from T C (L), so 
the sample contains many correlated regions, the system 
is almost self averaging. But around T C (L) the remain- 
ing randomness in other quantities does not necessarily 
scale to zero and, in order to use Eq.(||), we have to get 
rid of this extra noise by averaging. The "correlated av- 
erage" H requires then to find the critical temperature 
of a given sample, and average over realizations with the 
same T£. In practice, this means "shifting" and super- 
posing the curves of Q(T) measured on different random 
samples of the same size. 

We now test the above theoretical concepts on the two- 
dimensional random-bond Ising model. We simulated 
L x L systems (L = 32, . . . .128) with periodic bound- 
ary conditions using the Wolff @ single-cluster algorithm 
to overcome critical slowing down. Disorder was gener- 
ated from a bimodal distribution: bonds had two values, 
J\ and Ji (all positive) with equal probabilities. The 
strength of randomness was tuned by changing the ratio 
r = J1/J2 (r = 0.25,0.5). The exact critical temperature 
f3 c = l/ksT c of this model is known j|] as a function of 
r through : sinh(2/3 c J 2) sinh(2/3 c r J2) = 1. For each mea- 
surement, we used up to 10 4 Monte Carlo (MC) steps 
each comprising 10 cluster updatings and we used 10 
steps for equilibration. To avoid inaccuracies @] due to 
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FIG. 3. The same 20 realizations as in Figure 2 for L — 64 
and r = 0.5 after the shift. Inset: scaling with the correlated 
average (u = 1, 7 = 1.75 for L = 32 (50 real), L = 48 (20 
real), L = 64 (20 real) and L = 128 (20 real)). For each L, 
iXXmaic) is the temperature at the peak of the curve obtained 
after the correlated average. 



unfortunate choice of the random number generator, we 
compared results obtained from different generators. We 
concentrated on the susceptibility, defined as 



X = 



1 <m 2 ) - (\M\y< 



V- 



T 



(4) 



where M is the total magnetization of the sample. 

In Figure 2 we show the susceptibilities of different dis- 
order realizations of the same size (L — 64) as a function 
of temperature. We see large sample-to-sample fluctua- 
tions, exceeding the thermal fluctuations by at least an 
order of magnitude. At the same time, it is obvious that 
the curves are quite similar to each other, they are just 
"displaced" . This is exactly what we expect on the ba- 
sis of random RG trajectories: for each sample, T C (L) is 
different, which explains the displacement of the curves. 

To study the shape of the susceptibilities of the dif- 
ferent disorder realizations, in Figure 3 we "shifted" 
the curves to have each sample at the same T C (L) (see 
below for details). We emphasize that these are the 
very same data as in Fig. 2. The excellent overlap of 
the different samples' susceptibilities demonstrates that 
77 = T — T C (L) is indeed the good scaling variable. Fig. 
3 also shows that, as expected, disorder fluctuations are 
pronounced only at, or around T C (L). Our data indicate 
that the relative fluctuations of the peak heights, are in 
the same order for all studied system sizes, depending 
only on the disorder strength r. 

In terms of averaging over disorder, Figures 2 and 3 
correspond to the grand canonical and correlated aver- 
ages, respectively: the latter achieves a spectacular noise 
reduction, but it is still to see, which one reproduces the 
expected scaling of the very large system. 

Without randomness v pure = 1, and a perturbative 
RG approach predicts that small disorder is marginally 



dA 

dx 



— = -8A 2 + 0(A 3 ), 



(•5) 



where A is proportional to the square dispersion of the 
random bonds, and x cx ln(L _1 ). According to Eq.(^|), 
the disorder scales to zero, but only logarithmically with 
L, so we have to take it into account in the RG equations 
of other quantities, like the reduced temperature r, 



dr 
dx 



(l-4A)r 



(6) 



This equation predicts an effective exponent v e ff ~ 
1 + 4A, which approaches v pure — 1 very slowly. Since 
the randomness does not couple to the magnetization in 
first order, one expects that the susceptibility exponent 
7/1/ = 1.75 remains unchanged. Even though these re- 
sults were obtained by using replicas and grand-canonical 
disorder average, for a short-range-interaction model and 
very large system sizes we still expect them to be correct. 

The detailed form of the above scaling corrections is 
still under debate even today 11 1^. Here we wish to 
concentrate only on their qualitative nature: disorder in- 
troduces corrections to v (the width of the susceptibility 
peak), but not to j/v (the height of the peak at criti- 
cality). As we will see, this expectation is satisfied only 
with the correlated average. 

The major difficulty of the correlated average is to find 
T C (L) of a given disorder realization, and "shift" the dif- 
ferent samples' curves as in Fig. 3. Trying to identify the 
peak of the susceptibility for each realization is one pos- 
sibility Q, but both thermal and random fluctuations 
are biggest at this point. Instead, we used the entire 
susceptibility curves and minimized the "distance" |ll| 
between them. We verified that the final results do not 
depend on th e deta ils of this procedure, and the average 
critical point T C (L) scales to the exact T c when L — > 00. 
The exact values are T c = 1.641018 for r = 0.5 and 
T c = 1.239078 for r = 0.25. Our extrapolated L -> 00 
numerical results are T c = 1.640(1) and T c = 1.239(1) 
respectively. 

In the case of small disorder, r = 0.5, we found cor- 
rections to scaling in the case of grand canonical average 
both for v and 7/f, though both of these corrections are 
relatively small. This violates what is expected for 7/V. 
On the other hand, for the available sizes, the correlated 
average gives an almost perfect scaling plot with the pure 
exponents, as shown in Figure 3 (inset). No corrections 
were visible here. 

The differences between the two disorder averages are 
even more pronounced for stronger disorder, r = 0.25. 
Clearly, for the grand canonical average (Fig. 4) not 
only the widths but also the heights of the peaks show 
sizable corrections to scaling. Note that there are no 
corrections for the heights (scaled by 7/^) when the data 
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FIG. 4. Grand canonical average, r — 0.25 (y 
7 = 1.75). 
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FIG. 5. Correlated average, r = 0.25 {y = 1 and 7 = 1.75, 
inset: l/v ~ 0.92 and 7/1/ = 1.75). 



have been evaluated with correlated average (Fig. 5). 
For this disorder strength the corrections in v already 
appear, and an effective thermal exponent \jv e tj ~ 0.92 
gives a good description of the data within this range 
of sizes (see the inset of Fig. 5). We emphasize that 
only the results of the correlated average reproduce our 
expectations for the infinite system scaling. 

In addition to the susceptibility, other singular quan- 
tities, like the specific heat, show critical behaviour. A 
question of consistency arises: Do the same temperature 
shifts calculated from the susceptibilities of different sam- 
ples give the best collapse of the specific heat curves? In- 
deed, the answer is yes, as can be seen in Fig. 6. This 
supports our theory that t£ = T — T C (L) of a given sam- 
ple is a good scaling variable for any critical quantity. 

We have proposed a new picture of the RG in ran- 
dom systems, which leads to a recently introduced way 
of disorder averaging for FSS, the so called "correlated 
average" 0. We studied in detail the FSS properties of 
the d = 2 disordered Ising model, and found that only the 
correlated average reproduces the expected behaviour of 
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FIG. 6. Collapse of the specific-heat curves using the same 
shifts of temperature as in Figure 3 (r = 0.5, L = 64). 



the susceptibility, in addition to spectacular noise reduc- 
tion in averaged quantities. A detailed account of our 
simulations' results will be published elsewhere. 
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